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A new type of topological spin-helical surface states was discovered in layered van der Waals 
bonded (SnTe)n=2,3(Bi2Te3)m=i compounds which comprise two covalently bonded band inverted 
subsystems, SnTe and Bi2Te3, within a building block. This novel topological states demonstrate 
non-Dirac dispersion within the band gap. The dispersion of the surface state has two linear sections 
of different slope with shoulder feature between them. Such a dispersion of the topological surface 
state enables effective switch of the velocity of topological carriers by means of applying an external 
electric field. 


PACS numbers: 71.20.Nr, 73.20.At, 85.75.-d 


2 


INTRODUCTION 


A topological insulators (TIs) are materials with a gap in bulk electronic spectrum driven by the spin-orbit 
interaction (SOI), which is topologically distinct from the ordinary insulators. This distinction, characterized by 
a Z2 topological invariant, is manifested in the existence of the time-reversal-symmetry protected spin-helical gapless 
surface state having linear (or almost linear) Dirac dispersion. 

Starting from the discovery of the TI phase in the quintuple layer (QL) structured binary compounds Bi2Te3, Bi2Se3, 
and Sb2Te3 and its thorough experimental and theoretical investigation [ll-Q a huge number of Z2 TIs were found. 
The most of known TIs are Bi2Te3-type ternary and quaternary layered materials. Among them QL and septuple layer 
(SL) structured compounds as well as the materials with alternating QL and SL units were theoretically predicted 
and experimentally confirmed. [iMl 

Another class of topological materials is materials with band gap inverted by strong spin-orbit interaction in which 
the topological surface states are protected by the crystal mirror symmetry 0 - so-called topological crystalline 
insulators (TCI). One representative of a TCI is SnTe, Em showing an even number of the Dirac cones in the 
surface spectrum. 

Recently it was demonstrated that in the Bi2Te3/SnTe heterostructure, the system containing Z2 and crystal mirror 
symmetry TIs, the T Dirac surface states of Bi2Te3 and SnTe annihilate at the interface while the Dirac state of SnTe 
at the M “survives”. 0 This points out that the interaction of Z2 TI and TCI systems can results in unusual change 
in topological surface states picture. 

Different systems, containing layers of band-inverted Bi2Te3 and SnTe materials are (SnTe)n(Bi2Te3)^ compounds. 0 
In this series the (n = l,m compounds - SnBUTer, SnBieTeio, and SnBi8Tei3 are structurally identical to 

earlier studied lead-based TIs [l 0 |, containing alternating QL and SL structural units, while the (n > l,m = 1 ) 
compounds are formed by unique, nonalternating building blocks. The simplest system (n = l,m = 1 ), i.e. SnBi2Te4 
is composed by SL hexagonally ordered blocks stacked along the c axis and separated by van der Waals spacings. 
The SL building block (Fig. [Hb)) can be obtained from the original QL block of Bi2Te3 (Fig. [D^a)) by introducing 
the SnTe bilayer between the Bi atomic layer and the central Te one. This compound was predicted to be 3 D Z2 
TI with single Dirac cone in the bulk energy gap 0 . The Sn2Bi2Te5 compound (n = 2 ,m = 1 ) is formed by 
nonuple layer (NL) building blocks [l 8 |. The NL block (Fig. [Il^c)) is constructed from SL block by introduction 
additional SnTe hexagonal bilayer in the middle of the SL or two bilayers into original QL. Thus this compound 
differs from Bi2Te3/SnTe heterostructure having the ionic-covalent bonded Bi2Te3 and SnTe atomic layers. Another 
experimentally confirmed structure (SnTe)n(Bi2Te3)^, which is also built from the ionic-covalent bonded Bi2Te3 and 
SnTe atomic layers is Sn3Bi2Te6 {n = 3 ,m = l).[l 8 [ In this case additional SnTe layers are incorporated into the 
building block (Fig. [Hd)). We are not aware of the possibility of growth of stable (SnTe)n(Bi2Te3)^=i compounds 
with larger n which have building blocks of the same type. 

In the present paper we demonstrate by means of relativistic density functional theory (DFT) calculations that 
(SnTe)n=2,3(Bi2Te3)^=i compounds are Z2 TIs, in which owing to complex band inversion of bulk states belonging 
to Bi2Te3 and SnTe subsystems at the surface arise the topological surface state (TSS) demonstrating non-Dirac, 
dog-leg dispersion within the bulk energy gap. We discuss the localization and spin texture of the TSS in the context 
of gate control of the topological transport properties. We also demonstrate the existence of such a TSS in Sn2Sb2Te5 
compound. 

For calculations we use the Vienna Ab Initio Simulation Package (VASP) 0 0 with generalized gradient 
approximation (GGA) [ 2 l| for the exchange correlation potential. The interaction between the ion cores and valence 
electrons was described by the projector augmented-wave method. 00 Relativistic effects, including SOI, were taken 
into account. The atomic positions of bulk (SnTe)n=2,3(Bi2Te3) compounds were optimized. In slab calculations a 
vacuum space of 20 A was included to ensure negligible interaction between opposite surfaces. Gomplementary 
calculations for bulk band structure were performed using the fullpotential linearized augmented plane-wave method 
as implemented in the FLEUR code. [2^ 


RESULTS 

The bulk band structures of Sn2Bi2Te5 shown in Fig. [ 2 ] have been calculated with and without SOI included. As 
can be seen from Fig.[ 2 l^a), the direct energy gap of 0.32 eV exist at the F point in the calculation without SOI which 
transforms into indirect gap of 0.12 eV under switch on the SOI (Fig. EJb)). The time-reversal invariant momenta 
(TRIMs) in this Brillouin zone are the F, A and triply degenerate M and L points. We checked the parity of the 
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FIG. 1 . (Color online) Building blocks of Bi2Te3 (a); SnBi2Te4 (b); Sn2Bi2Te5 (c); and Sn3Bi2Te6 (d). 



C w/o SOI e SOI 



FIG. 2 . (Color online) Bulk electronic structure of Sn2Bi2Te5 calculated without (a) and with (b) SOI included (Signs of band 
parities at the TRIM are also shown). Atomic composition of the near-gap states in bulk Sn2Bi2Te5 calculated without (c,d) 
and with (e,f) SOI included. 
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FIG. 3 . (Color online) (a) Surface electronic structure of Sn2Bi2Te5; The size of the color circles represent the weight of the 
states in the outermost building block (NL) of the slab; red and blue colors show the sign of the in-plane (Sx and Sy) spin 
components; lightpink and lightgreen rectangles mark the areas of the bandgap and valenceband topological surface states, 
respectively. Atomic weights of Bi and Sn in the bandgap (b) and valenceband (c) TSSs. (d) Energy dispersion of the bandgap 
TSS compared to Bi2Te3 and SnTe f Dirac cones. Dashed and dot-dashed lines are linear fit for the TSS above and below 
shoulder, respectively, (e) Dispersion of the valenceband TSS compared to Bi2Te3. (f) Constant energy contours in the shoulder 
region (yellow stripe in panel (d)). (g) Spin-resolved constant energy contours for bandgap TSS at energies of 25 meV below 
and above the shoulders. Arrows adjacent to the contours denote the in-plane spin component S\\. The out-of-plane spin 
component Sz is indicated by the color with red and blue corresponding to the positive and negative values, respectively, (h) 
The spin components S\\ and Sz for bandgap TSS as functions of along the T-K direction. 


wavefunctions at all TRIMs to determine the topological character of this material and found that the parity inversion 
of bulk bands occurs at the F point which leads to Z2 invariants 1 ;( 000 ) like in Bi2Te3. 

In spite of this similarity in SOI-induced wavefunction parity change, the total band inversion at F is an entanglement 
of two different inversions corresponding to each subsystem due to the complex crystal structure of the compound. For 
instance, in Bi2Te3 the SOI modifies the top valence band state (predominantly of pz character) of Te atoms lying in 
the outer layers of QL (Tcq) and the Bi pz-stdite of the bottom conduction band so that they are inverted in the close 
vicinity of the F point. A similar simple band inversion occurs in the bulk SnTe where Sn and Te states are inverted 
in the L point of the cubic Brillouin zone. Instead, in Sn2Bi2Te5 the spectra calculated without SOI both Bi and 
Sn states form the bottom of the conduction band while the states of Tcq atoms and tellurium atoms of the central 
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layer of NL (Tec) He in the top valence band (Fig. [ 2 fc,d)). Switching on the SOI results in an inversion of Bi and Tcq 
states and Sn and Tcc states. However, in contrast to the binary systems this inversion has more complex character. 
As can be seen in Fig. [ 2 fe) after switching on the SOI the Tcq states become dominant in the conduction band while 
the Bi states (in contrast to the Bi2Te3 case) occupy the second valence band in the vicinity of F. The SOI-inverted 
Sn states lie in the highest valence band and Tcc states appear in the second conduction band Fig.[ 2 jf). Additionally, 
the SOI-inverted Sn states (with smaller weight) appear in the second valence band. Thus, the Sn2Bi2Te5 TI has a 
competitive bulk F-gap band inversion which comprises the inversion of the states belonging to different subsystems, 
SnTe and Bi2Te3, so that the valence band edge is mainly formed by Sn states and the conduction band edge occupied 
by Tco states while the Bi and Tcc states he next to the edges bands. 

Such a superposition of the SOI-induced bulk band inversions in the the SnTe and Bi2Te3 subsystems of the 
(SnTe)2(Bi2Te3)i TI results in formation of unusual topological states on the surface. In the surface spectrum two 
topological surface states arise at the F point. The upper TSS lies in the band gap (see lightpink rectangle in Fig.[ 3 K) 
while the lower TSS (lightgreen rectangle in Fig. [ 3 tt) resides in the valence band (bandgap and valenceband TSS’s, 
respectively from now on). The lower, valenceband TSS, propagating within the local valence band gap, has typical 
Dirac dispersion for TIs. In contrast, the bandgap TSS displays nonlinear (non-Dirac) dog-leg behavior. It has two 
linear sections in the spectrum: near the band crossing (Dirac point) and below the conduction band which connect 
to each other in the middle part of the gap with formation of shoulders in the spectrum. Like in other TIs, the TSSs 
in Sn2Bi2Te5 are localized within outermost building block of the slab. However, in this case, where the building 
block has two band-inverted SnTe and Bi2Te3 subsystems, the localization of the TSS is affected by the peculiarities 
in the bulk band inversion. Figs. [ 3 fb,c) show the Bi and Sn atomic weights in the TSSs. As one can see in Fig. [ 3 fc), 
the valenceband TSS has dominant Bi weights that reflect its dominant localization in the outer Bi-Te layers of NL. 
Comparing the dispersion of this state with that of the Dirac cone in Bi2Te3[H (Fig. life)) one can conclude that 
at small (where the valenceband TSS has localized character) both bands are almost identical. In the bandgap 
TSS (Fig. [ 3 fb)), the lower linear section near the band crossing, the Sn contribution dominates and thus the state 
is mainly localized in the inner Sn-Te layers of NL. Approaching the shoulders the Sn contribution disappears rather 
quickly and above the band shoulders the TSS becomes to be mostly localized in the outer Bi-Te layers. Thus 
the band shoulders in the TSS spectrum are associated with the change of the TSS localization from the SnTe to 
Bi2Te3 subsystem. It should be noted that the slope of the upper linear section of the bandgap TSS (at > 0.1 
A“^) localized in the outer Bi-Te layers is comparable with the slope of the Bi2Te3 Dirac cone (Fig. O^d)), while the 
dispersion of the lower linear section (/cy < 0.05 A“^) differs considerably from both Bi2Te3 and rocksalt-SnTe[^ 
F Dirac states. As a consequence, the linear fitting for lower and upper sections of the bandgap TSS (dot-dashed 
and dashed lines in Fig. [ 3 fd)) gives E/k\\ slopes of 2.22 and 1 . 13 , respectively. Between these linear sections, in 
the shoulder region at 0.05 < k\\ < 0.1 A“^, two inflection points exist which limit almost flat section in the TSS 
spectrum. Such very low velocity regime in the bandgap TSS resembles heavy-fermion topological state that has 
been proposed theoretically and obtained from magnetothermoelectric transport measurements in topological 
Kondo insulator (TKI) SmBe- Owing to slightly negative dispersion of the TSS in the shoulder region (see narrow 
yellow stripe in Fig. [ 3 fd)) by varying the chemical potential the system will pass from one velocity mode in the lower 
linear section to the other velocity mode in the upper linear section through the three surface Fermi pockets regime 
at energy ^50 meV (Fig. [ 3 ff)). 

The detailed spin texture of the bandgap TSS is illustrated in Figs. [ 3 l^g,h). Fig. [ 3 fg) shows spin-resolved constant 
energy contours (CEC’s) for the lower (inner contour) and upper (outer contour) linear sections of the TSS. Both 
contours, apart from the in-plane clockwise spin polarization, also demonstrate the presence of the out-of-plane spin 
component, which is intrinsic feature of the spin-polarized states at hexagonal surfaces while Sz for the inner contour is 
extremely small. As clearly seen for the outer contour, Sz is zero along F-M and reaches a minimum (maximum) value 
in F-K directions. The dependencies of absolute values for and Sz on k\\ along F-K are shown in Fig. ^h). The 
in-plane spin polarization having maximum near the band crossing point rapidly decreases approaching the shoulder. 
At fell > 0.1 A-i, i.e. in the upper linear section, it increases with k\\ until it reaches the region of the bulk states. In 
contrast, the out-of-plane spin polarization increases with k\\ in both linear sections of the TSS, having a kink at the 
band shoulder. 

The increase of the SnTe layers in the building block of (SnTe)n(Bi2Te3)m=i compound up to n = 3 maintains the 
two TSSs in the surface spectrum as well as dog-leg behavior in dispersion of the bandgap surface state (Fig. lU^a)). 
The difference from the Sn2Bi2Te5 case is that the band shoulders lie closer to the bulk valence band making lower 
section of the TSS very short and two times less steep. 

Another way to modify the parameters of the bandgap TSS is substitution of Bi by Sb. In this case SnTe layers are 
introduced into Sb2Te3 TI forming (SnTe)n(Sb2Te3)^=i compound. As can be seen in Fig.lU^b) the surface spectrum 
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FIG. 4. (Color online) Spin-resolved surface electronic structure of Sn 3 Bi 2 Te 6 (a) and Sn 2 Sb 2 Te 5 (b). 

of Sn2Sb2Te5 also holds two TSSs with dog-leg dispersion in the bandgap TSS. However, in contrast to the previous 
case the band shoulders arise near the conduction band. 


SUMMARY 

In summary, on the basis of ab initio DFT calculations we have demonstrated that (SnTe)n=2,3(Bi2Te3)m=i 
compounds are Z2 topological insulators in which, owed to superposition of two pairs of SOI-induced band inversions 
realized in SnTe and Bi2Te3 subsystems, two spin-helical topological surface states arise at the F point. These states 
reside in the band gap and in the local gap of the valence band. The latter TSS, lying deep below the Fermi level, has a 
dispersion similar to that in the Bi2Te3 TI, while the bandgap TSS demonstrates unusual non-Dirac dog-leg dispersion 
with two linear sections of different slope and very low-velocity shoulder section between them. In Sn2Bi2Te5 the 
shoulders are located in the middle of the gap and velocities of carriers in lower and upper linear sections differ by a 
factor of two. Thus in contrast to all hitherto known TIs, where the slope of the spin-helical TSS is linear or varies 
smoothly with energy, the bandgap TSS in (SnTe)^=2,3(Bi2Te3)^=i compounds shows abrupt switch of the velocity 
of topological carriers with change in the Fermi surface topology in the narrow energy range (shoulder section) where 
spin and charge current should be blocked. We also demonstrated that similar TSSs exist in (SnTe)n=2(Sb2Te3)m=i 
compound. This novel finding enhance the understanding on the diversity of topological surface states and pave a 
way for the efficient control of the group velocity with sufficiently large spin current density by tuning the chemical 
potential. 

Further tuning of the bandgap TSS parameters can be realized by using (Bii-a^Sb^^ )2Te3[2i,|2^ orBi2(Tei_^Se^)3[2i, 
compounds as basic TIs for construction of (SnTe)n((Bi-Sb)2(Te-Se)3)^=i systems. 
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